Without fanfare, Tesla has introduced their most refined self-driving computer, Hardware 4.0 (HW4), into the Model Y lineup. It's a surprising move, as it was believed HW4 would roll out with the Model Y redesign. This strategic decision, executed in Tesla’s unique, understated style, follows the quiet integration of HW4 into the luxury Model S and Model X models earlier this year.
This shift came to light thanks to one of our sources, who has provided accurate information in the past. Tesla owner Zack (@BLKMDL3) has now identified multiple Model Y units equipped with fresh hardware at his local delivery center. The distinctive upgraded side repeater and forward-facing cameras indicate HW4 were observed in both Long Range and Performance variants of the Model Y.
Transitioning to the New Standard
Notwithstanding these exciting sightings, numerous Model Ys with the previous hardware was still found at the delivery site. As is customary with Tesla’s approach to hardware rollouts, the full switch to HW4 across all Model Ys will take some time as Tesla factories incorporate these changes.
Source code information connected to a recently manufactured Model Y also confirmed the presence of HW4, designated as "AP HW4". Interestingly, this phased implementation might lead to disparities among Model Y units depending on their manufacturing origin. For instance, those made in China, where no HW4 incorporation has been reported yet, might cause Canadian customers to miss out on the HW4 upgrade.
HW4: Paving the Way for Enhanced Autonomy
Tesla’s HW4 represents the company’s commitment to refine its vision-based self-driving system further, shifting from the previous reliance on a combination of vision and radar sensors. It plays a pivotal role in Tesla’s bold objective to master Full Self-Driving (FSD) by year-end.
Nonetheless, it's worth noting that certain functionalities were not instantly available during the early stages of HW4 deployment. This factor likely played a role in Tesla's decision to delay its introduction of the Model Y. As Tesla continues perfecting HW4, further enhancements are anticipated, including improved handling of complicated maneuvers, such as unprotected turns.
Tesla has introduced hardware 4.0 for the Model Y
BLKMDL3/Twitter
The Hardware Evolution: Comparing HW4 and HW3
Insightful images shared by the Tesla community have provided a comparative look between HW4 and its predecessor, Hardware 3.0 (HW3). Of note, the side repeater cameras on the Model Y with HW4 have noticeably larger lens housings and a wider field of view. This departs from early anticipations, which projected HW4 would introduce additional cameras. Instead, the updated hardware seems to enhance the existing camera system.
What Lies Ahead
The introduction of HW4 into the Model Y marks a remarkable stride in Tesla's commitment to perfecting Full Self-Driving technology. As Tesla continues to develop and refine HW4, it's exciting to envision the transformative potential this holds for the automotive landscape.
While Tesla CEO Elon Musk’s ambitious vision of a Robotaxi fleet may still be some way off, the integration of HW4 in the Model Y undeniably represents a key milestone in that journey. As this revolutionary technology evolves, the world eagerly awaits the exciting advancements it promises to bring to the autonomous driving experience.
Subscribe
Subscribe to our newsletter to stay up to date on the latest Tesla news, upcoming features and software updates.
Tesla has just rolled out its latest FSD software, v12.4 to employees. Elon Musk announced that this update would be available to employees this past weekend, with plans to release it to the public in small numbers later this week.
However, as we predicted, Tesla will still leverage the steering wheel to detect attentiveness when the cabin camera is inconclusive.
The car can only rely on the vehicle's cabin camera, and therefore remove the steering wheel nag under certain conditions:
the camera is not occluded
there is sufficient lighting
the driver is looking forward
the driver is not wearing sunglasses
the driver is not wearing a low-brim hat or another object that covers their eyes
If any of these situations occur, or if the vehicle doesn't have a cabin camera, then the vehicle will continue to use the steering wheel to determine driver attention.
Tesla is careful to state that images and video from the cabin camera are not saved or transmitted unless you enable data sharing.
Updated Strike System
With FSD v12.4, Tesla has also updated its Autopilot Suspension feature which is designed to enforce the responsible use of FSD.
The current system lets the driver receive up to five strikes (three strikes for vehicles without a cabin camera) before Autopilot and FSD become unavailable. If that happens, then FSD is unavailable for one week. Strikes are only removed once the driver has accrued five strikes, or when Tesla wipes out strikes for everyone, which happens about twice a year.
The new system is more gracious about removing strikes. The vehicle will continue to issue strikes whenever the driver isn't paying attention, however, now the vehicle will gradually remove strikes for the driver after a certain period of time.
Tesla states that one strike will be removed for each 7-day period the driver goes without receiving a strike. So if FSD gets disabled due to strikes, the driver will still go one week without FSD, although now strikes are removed on an ongoing basis. This new strike system is expected to apply to vehicles with and without a cabin camera.
They include a focus on improved driver comfort by reducing the amount of hard braking, automatically seeking a parking spot when arriving at a destination and more. Driver interventions are also expected to be drastically reduced with Musk stating that Tesla expects to see a 5-10x improvement in interventions.
Eligibility
Unfortunately, due to FSD v12.4 being on branch 2024.9, it's expected to only be available to owners on update 2024.8 and below, which includes everyone currently on update 2024.3.25.
If no major issues are found with FSD v12.4, we could see it start to roll out to the public later this week.
Tesla has been improving its FSD features since introducing it in 2016
Tesla
Previously, the Tesla X account shared a video where FSD V12 appeared to consider a pedestrian’s hand gestures when navigating. Elon Musk also confirmed on X that hand gesture recognition would be improved in V12.4, and even better by V12.5.
Tesla has had plans for gesture recognition for many years, with Musk mentioning hand gesture recognition in 2021. FSD is supposed to be able to adapt to new and unique circumstances in a safe manner, whether following instructions from a police officer, or understanding the hand signals from a cyclist.
Boris Johnson and FSD
Boris Johnson, the ex-Prime Minister of the UK, recently got to experience FSD V12 in the crowded streets of LA, with his wife and child in the backseat. Tesla provided a vehicle and assistant for his self-driven experience through 5-road intersections, heavy traffic, and pedestrians.
At the end of about 45 minutes I feel like a driving test examiner – except that I want to tell the car that it has passed, with flying colours. -Boris Johnson
Gestures coming soon
Johnson had a single experience with hand gestures in his drive – being waved at a hotel. While the car didn’t recognize the gesture – even on FSD V12.3.6 – the Tesla official in the vehicle confirmed that “‘It doesn’t yet recognise that gesture, but we are fixing it for the next iteration. It should be done next month.”.
It’s not immediately clear whether the Tesla employee is referring to FSD v12.4, which is expected to start rolling out to the public later this week, or Tesla’s next major FSD release, V12.5. According to Musk, V12.5 is expected to handle much more complicated situations and even start vehicle-to-fleet communication.
Yeah, I wouldn’t count on this in 12.3.x, but 12.4 is a big improvement and 12.5 might nail it
When you’re tackling a problem like FSD, which has never been solved before, you sometimes have to pivot and realize there’s a better approach. That’s what Tesla has done with FSD and AI. Just a few years ago where people thought cars would need to be able to read signs to achieve autonomy, but with the latest approach, there’s no need to. As long as the vehicle has seen a specific sign before and has enough examples, it’s already trained on what humans do when such a sign is found. The same will be true for hand gestures, the vehicle won’t need to know what each hand gesture means, it’ll just recognize that when a current gesture is made, this is how the vehicle should react.
Tesla does this by feeding it millions of examples of very specific situations and AI recognizes patterns. This is an example where Tesla leverages fleet data. They can easily capture millions of examples of hand gestures and how humans reacted, and feed that to their AI training model.
As Tesla processes more video, FSD will continue to improve. Tesla is expected to spend $10 billion on AI this year alone, most of it going toward improving FSD.
TeslaFi logs your drives and charging sessions, letting you keep a log of your vehice's activity. We highly recommend checking them out if you use your car for business trips and would like to keep track of reimbursements, if you like to see how much you spend on charging or if you just love statistics. Visit their site and see everything they have to offer!
Tesla Android Project enables you to run Android apps in your Tesla. The platform is Open Source and you can deploy it on your own Raspberry Pi 4. Consider supporting the initiative by donating or purchasing the Compute Module 4 Bundle that delivers the best experience. Get $20 off by using the code: NotATeslaApp
The official Tesla app only notifies you if your car is broken into. By installing Sentry Pro on your phone, you will be notified for all Sentry Mode events. Stay connected and avoid potential surprises by receiving notifications. Stop constantly checking the cameras to ensure safety. Check only when necessary, save battery and get peace of mind. Get a 7 day free trial here!
Stay organized, connected, and stylish with Cyberbackpack — the #1 backpack, luggage & travel accessories for Tesla owners. We highly recommend checking them out if you commute or travel and would like a backpack or luggage that is sleek, secure and durable. View their products page and see everything they have to offer!